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1  Introduction 


This  project  pertains  to  the  development  of  a  theory  for  adaptive  control  of  nonlinear  dynamic  sys¬ 
tems  that  are  nonlinearly  parametrized  (NLP).  Nonlinearly  parameterized  (NLP)  dynamic  systems 
are  ubiquitous  in  practical  applications.  Problems  related  to  friction  compensation  [1],  reactors  [2] 
are  some  of  the  examples.  A  large  class  of  nonlinear  models  which  are  combinations  of  linear  dy¬ 
namics  together  with  static  nonlinearities  such  as  Hammerstein-Uryson  representations  [3],  as  well 
as  neural  network  models  [4]  are  examples  of  dynamic  systems  with  nonlinear  parameterization. 

One  of  the  most  common  assumptions  made  in  the  context  of  adaptive  control  is  that  the  un¬ 
known  parameters  occur  linearly,  and  appear  in  linear  [5]  and  nonlinear  systems  [6,  7,  8,  9],  The 
field  of  adaptive  control  has,  by  and  large,  treated  the  control  problem  in  the  presence  of  paramet¬ 
ric  uncertainties  with  the  assumption  that  the  unknown  parameters  occur  linearly  [5].  Whether  in 
an  adaptive  observer  or  an  adaptive  controller,  the  assumption  of  linear  parametrization  has  dic¬ 
tated  the  choice  of  the  structure  of  the  dynamic  system.  For  instance,  in  adaptive  observers,  the 
focus  has  been  on  structures  that  allow  measurable  outputs  to  be  expressed  as  linear,  but  unknown, 
combinations  of  accessible  system  variables.  In  direct  adaptive  control,  a  model-based  controller 
is  chosen  so  as  to  allow  the  desired  closed-loop  output  to  be  linear  in  the  control  parameters.  In 
indirect  adaptive  control,  estimators  and  controllers  are  often  chosen  so  as  to  retain  the  linearity 
in  the  parameters  being  estimated.  The  design  of  stable  adaptive  systems  using  the  classical  aug¬ 
mented  approach  as  in  [5]  or  using  adaptive  nonlinear  designs  as  in  [10]  relies  heavily  on  linear 
parametrization. 

The  problem  is  an  important  one  both  in  linear  and  nonlinear  dynamic  systems,  albeit  for  dif¬ 
ferent  reasons.  In  nonlinear  dynamic  systems,  despite  the  fact  that  the  majority  of  results  have 
sought  to  extend  the  ideas  of  feedback  linearization  to  systems  with  parametric  uncertainties  using 
the  certainty  equivalence  principle,  it  is  only  within  the  context  of  linearly  parametrizable  non¬ 
linear  dynamics  that  global  results  have  been  available.  Obviously,  it  is  a  nontrivial  task  to  find 
transform  methods  for  general  nonlinear  systems  so  as  to  convert  them  into  systems  with  linear 
parametrizations.  In  linear  dynamic  systems,  it  is  quite  possible  to  transform  the  problem  into  one 
where  unknown  parameters  occur  linearly.  However,  such  a  transformation  also  can  result  in  a 
large  dimension  of  the  space  of  linear  parameters.  This  has  a  variety  of  consequences.  The  first 
is  due  to  over  parametrization  which  requires  much  larger  amounts  of  persistent  excitation  or  re¬ 
sults  in  a  lower  degree  of  robustness.  The  second  is  that  it  can  introduce  undue  restrictions  in  the 
allowable  parametric  uncertainty  due  to  possible  unstable  pole-zero  cancellations  [11]. 

During  the  past  three  and  half  years,  we  have  derived  several  new  results  related  to  NLP  sys¬ 
tems,  and  can  be  grouped  under  two  categories:  (i)  Control  of  systems  with  a  triangular  struc- 
ture[Pl],  and  (ii)  Parameter  convergence  in  NLP  systems [P2]-[P6].  These  results  are  summarized 
below. 


2  Triangular  structures 


The  stage  for  controlling  NLP  systems  has  been  set  in  [12, 13,  14,  15],  where  a  new  approach  was 
developed  to  accommodate  the  parametric  nonlinearity.  In  these  investigations,  it  was  assumed 
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that  the  underlying  system  satisfies  the  matching  conditions[16],  That  is,  the  nonlinear  system  is 
of  the  form 


Xp  —  ApXp  +  9)  +  m)  (1) 

where  /  is  a  scalar  nonlinearity  in  the  unknown  parameter  9.  This  leads  to  the  obvious  question 
as  to  whther  the  approach  in  [12]  can  be  extended  to  systems  where  these  matching  conditions  are 
not  satisfied.  Investigations  in  this  direction  led  to  the  following  result: 

The  class  of  NLP-systems  that  we  considered  is  of  the  form 


Z\  —  z2  +  fi(zi,9) 

z2  =  Z3 


(2) 


where  6  e  a  compact  set  in  1R.  The  goal  is  to  find  a  u  that  globally  stabilizes  the  system  when  9  is 
unknown  and  Vs  are  accessible. 

The  following  controller  can  be  shown  to  lead  to  global  stability.  Define  a  tuning  error  en_i 
using  the  following  recursive  relation: 


e0  =  zx 

ei  =  z2  +  gi(z1) 

e2  =  eo  +  z3  +  g2(zi,  z2) 


(3) 


—  e,_2  +  Zi+i  +  gi(zi, ...  ,Zi)  i  =  l,...,n  —  l 


where 


9i(zi,  ■  ■  ■ ,  Zi) 
h{z\)  =  ki(zi) 
k2{zi,z2) 


ki-l(zi,  .  .  .  ,  Zi_ i)  +  hi^i(zi,  .  .  .  ,  Zi-i)  +  -TT—Zi, 

OZ\ 

0 

dg\  dhi 

z 2  +  zr~2z2  +  — z2 

UZl  OZ\ 


i  =  2, . . .  ,n  —  1 


ki(zu  . . . , 

h0(zi,9)  =  fi(zu9); 

hi(zi, . . .  ,Zi,9) 


i  ( &g\  ^  dgi  U  ( dk^i  dhi~i\ 

ki -2 + Zi + (&n Z2 + &iZi-' + £  (■ + zt+i> 

i  =  3, . . . ,  n  —  1 


hi(zu9)  =  !^/iCzi,0) 

hi- 2 + (it*) Zi/,(Zi,fl) + (isr + isf) 

i  =  2, . . .  ,n  —  1 


(4) 
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with  and  hi(-)  such  that 

(/i  -  9i)a(eo)  <  0  (5) 

(hi  —  hi)a(ei)  <0  i  =  l,...,n  —  1  (6) 

and  the  control  input  is  given  by 

U  —  fn(z  1)  z2i  -  •  •  )  ^n)  &n—2  ®  Sftt(en_i)  (7) 

/n  =:  kn— l(Z\,  . . . ,  zn)  +  zn  +  hn—i(zi, .  .  .  ,  Zn,  0)  (8) 

0  =  —en-icj*  7n>0  (9) 

a*  and  cu*  are  solutions  of  the  following  min-max  problem: 

(g*,oj*)  =  minmax  [/„  —  fn  +  (9  —  9)uj\  (10) 

uj  $  L  J 


g  and  h  can  be  chosen  so  as  to  satisfy  eqs.  (5)  and  (6)  in  the  following  manner:  g  is  a  bounding 
function  for  /  chosen  as 


fM 


m^c  [0,  f(x i,  6)}  +  6/  V  Xi  >  0 
min[0 ,f(xi,9)]-ef  V  xx  <  0 


(11) 


where  e/  is  an  arbitrary  constant.  Then,  define  a  bounding  function  as: 

F(xx)  \/\Xx\>€ 


G(x  x) 


S(xx)  V  laral  <  e 


(12) 


where  e  is  also  an  arbitrary  positive  constant  such  that  e  <  ej,  and  S(x i)  is  an  arbitrary  smooth 
bounded  function  such  that 

•S(x)  —  F(x) 

(13) 


dS(x)  _  dF(x) 


dx 


dx 


for  |x|  =  e. 


The  proof  of  global  stability  of  the  proposed  controller  can  be  established  as  follows:  From  the 
definition  of  the  errors  ez  in  Eq.  (3),  it  can  be  shown  that 


We  define  for  i  =  1, . . . ,  n. 


eo  =  ei  +  fi-  gx 

dgx  , 

ex  —  zz  +  7; — z2  +  hi 

OZ\ 


dgx 


(14) 


fi(z  1  j  •  •  •  >  zii  d)  —  ki— x (Zx-i  •  •  •  j  %i— l)  f  n  Z{  -(-  hi— 1  (zx,  .  .  .  ,  Zi,  0) 

OZ\ 


and  zn+ x  =  u.  It  can  then  be  shown  that 


ei  =  z3  +  f2(zx,z2,0) 
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The  method  of  induction  can  be  used  to  show  that 

e*  =  zi+ 2  +  fi+i  (zi , . . . ,  zi+l ,  9) 
This  follows  by  using  the  relations 


Cj  —  ej_2  +  Zi+ 1  +  gi 


and 


(15) 


ei- 2  =  Zi  +  fi-i(zi,z2,...,Zi-.i,0) 

and  the  definitions  of  &*,  hi,  and  /j.  As  a  result  equations  (14),  (15),  i  =  1, . . . ,  n  —  1,  and  (7)-(9) 
define  the  closed-loop  adaptive  system. 


We  choose 

v  - 

as  a  Lyapunov  function  candidate  for  the  closed-loop  adaptive  system.  This  leads  to  the  time- 
derivative 

71  —  1  _ 

V  —  eo^o  +  ^2  Ci(zi  +  2  +  /i+i)  — 

2  —  1 

71  —  2 

=  53  ei  (/i+l  _  ft+l)  +  e«-l  (/n  -  /n  -  0*sat(e„_i)  +  0W*)  (16) 

2=0 

Eqs.  (5)  and  (6)  imply  that  the  first  term  is  nonpositive.  Eq.  (10)  implies  that  the  second  term  is 
nonpositive.  Together,  they  lead  to  the  conclusion  that  e*,  i  =  0, ...  ,n  —  1,  and  6  are  bounded. 
From  the  definition  of  the  e/s  it  can  be  shown  that  for  i  —  1, . . . ,  n,  jz,-  and  u  are  bounded,  and  that 

lim^oo  Zi(t )  0. 


Extensions  of  the  above  result  when  (i)  zi  is  required  to  track  a  desired  trajectory  (ii)  when 
bounded  disturbances  di  are  present,  and  (iii)  for  systems  with  triangular  structures  of  the  form 


=  71(^2)  +  fi{zi,6i) 

£2  =  'Yi{x)u  +  f2(XuX2,d2) 


(17) 


are  currently  being  investigated.  Preliminary  investigations  show  that  global  boundedness  can  be 
established  in  each  of  these  cases.  A  paper  [PI]  is  currently  under  preparation  summarizing  all  of 
the  above  results. 


3  Parameter  Convergence 

A  large  class  of  problems  in  parameter  estimation  concerns  nonlinearly  parametrized  systems 
(NLP).  In  the  past  few  years,  a  stability  framework  for  identification  and  control  of  such  systems 
has  been  established.  Over  the  past  three  years,  we  have  addressed  the  issue  of  parameter  con¬ 
vergence  in  such  systems.  Systems  with  both  convex/concave  and  general  parameterizations  have 
been  considered.  The  convergence  results  are  stated  separately  below  for  discrete  time  systems 
and  continuous  time  systems. 
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3.1  Convergence  in  discrete-time  systems 

In  [15],  we  showed  that  for  nonlinearly  parameterized  (NLP)  discrete-time  systems  of  the  form  of 

Vt  = 

an  adaptive  estimator  with  a  min-max  algorithm  leads  to  global  stability.  The  question  is  whether 
the  estimator  can  enable  parameter  convergence  when  the  parameterization  is  concave  or  convex. 
We  have  derived  sufficient  conditions  on  the  input  cj>  and  the  nonlinearity  /  under  which  parameter 
convergence  results  using  the  min-max  algorithm.  In  section  3.1.2,  a  specific  example  of  /  and  (f> 
that  satisfy  these  conditions  is  presented. 

3.1.1  Parameter  convergence  in  the  presence  of  concave/convex  nonlinear  parameterization 

The  underlying  dynamic  system  is  of  the  form: 

Vt  = 

Vt 

Ot 

kt  = 

pt 

at  = 

ut  = 

J(uj,  9)  = 

Jo 

where  <j) :  N  — *  !Rn.  For  any  4>  and  all  9  e  0  C  IRn,  where  ©  is  a  compact  set  in  lRn,  /  is  assumed 
to  be  either  concave  or  convex.  The  problem  is  to  find  conditions  on  (f)t  under  which  9t  converges 
to  9  asymptotically. 

It  is  assumed  that  the  function  /  at  any  time  instant  can  be  either  concave  or  convex  with  respect 
to  the  parameter  6.  This  property  of  /  shall  be  called  as  the  curvature  of  /.  It  should  be  noted  that 
the  case  when  /  is  linear  in  6  represents  the  transition  between  concavity  and  convexity  or  vice 
versa,  and  in  such  a  case,  the  curvature  can  be  labeled  as  either  being  convex  or  concave. 

In  LP  systems,  the  term  “persistently  exciting”  was  used  to  characterize  a  signal  which  was 
rich  enough  in  content  to  enable  the  convergence  of  parameter  estimates  to  their  true  values  by 
using  the  standard  linear  gradient-update  algorithms  (see  [17,  5]).  In  order  to  distinguish  it  from 
its  counterpart  for  LP  systems,  we  will  use  the  term  “NLP  persistent  excitation”  to  specify  a  signal 
which  allows  convergence  of  parameter  estimates  to  their  true  values  in  an  NLP  system,  using  the 
min-max  algorithm.  The  required  conditions  for  a  signal  to  be  NLP-persistently  exciting  are  stated 
in  Definition  1. 


fi&t-uQt-i) 

9t- 1  -  Tektytptu)t 
1 

A  +  UjfTgLOt 
max  {0,  at} 

2 


TTe  =  T,  >  0 


A  >  0 


I  Vt 


\Jo 


aT9  S  “ae  Sg n(Vt)J(u>9) 

It- i  —  wT  (6 1- 1  —  9). 


(18) 


min  max  sgn(%)  J(u,  9) 
went"  9ee  6  K  ’ 
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Definition  1  A  function  f  '■  N  — >  IR.n  is  NLP -persistently  exciting  with  respect  to  9),  where 
f  :  ]Rn  x  0  -»  IR,  if  at  any  time  instant  ta,  given  any  Q\,  02  £  ©  and  eg  >  0,  such  that 
||02  —  ||  >  eg,  there  exist  positive  constants  T  and  ej  and  a  time  instant  tp  £  [ta  +  l,ta  +  T], 
such  that 

(NLP-I)  |/  fa, e2)  -  /  fa,  9,) |  >  ef; 

and  att  =  tp,  either 

(NLP-IIa)  sign  (f(ftp,  92)  -  f{</>tp, 0i))  f  sign  (f{fta,92)  -  f{fta,0 1))  while  the  curvature  of 
f  at  ta  and  curvature  of  f  at  tp  are  the  same  or 

(NLP-IIb)  sign  (f(ftp,  92)  -  f(ftp,  0i))  =  sign  (f(fta,  02)  —  f{4>ta,9f)),  while  the  curvature  of 
f  at  ta  and  curvature  of  f  at  tp  are  different. 


The  requirements  for  NLP-persistent  excitation  consist  of  two  components.  The  first  compo¬ 
nent  is  condition  (NLP-I)  and,  when  /  is  linear,  it  is  equivalent  to  the  LP  persistent  excitation, 
as  shown  below.  Condition  (NLP-II)  is  a  second  component  of  NLP-persistent  excitation  and  is 
needed  to  overcome  the  presence  of  the  dead-zone  which  in  turn  was  required  in  the  min-max 
algorithm  to  ensure  stability.  Condition  (NLP-II)  essentially  states  that,  periodically,  the  probing 
input  f  should  be  such  that  /  is  appropriately  dithered  resulting  in  a  change  of  either  its  curvature 
or  its  magnitude. 

In  order  to  establish  parameter  convergence  in  Eq.  (18),  we  note  first  from  the  results  of  [15] 
that  ||0||  is  non-increasing  and  that  it  is  possible  for  adaptation  to  stop,  which  occurs  whenever  pt  is 
small.  To  accommodate  this  behavior,  the  following  notation  is  introduced.  Let  the  set  flD  denote 
the  set  of  all  time  such  that 

flD  =  {I  |  0  <  pt  <  ep}  ,  where  ep  is  a  constant  £  (0, 2).  (19) 

If  ep  is  sufficiently  close  to  zero,  then  LlD  represents  the  time  the  system  spends  in  the  “dead- 
zone”  where  parameter  adaptation  is  turned  off.  The  complement  of  Qd  is  defined  as  — 
{t\pt>  eP}.  The  question  therefore  is  whether  ft  can  be  chosen  so  that  the  trajectories  lie  in 
iff  sufficiently  often,  which  is  answered  in  the  affirmative  below.  As  a  first  step,  an  important 
lemma  which  states  a  necessary  condition  for  the  system  to  be  in  the  “dead-zone”  is  given.  This  is 
followed  by  Theorem  1  which  presents  the  main  result  in  parameter  convergence. 


Lemma  1  For  the  adaptive  system  given  by  Eq.  (18),  ift  £  0#  then  either 

(Dl)  ft- 1  is  concave  in  9,  and  yt  >  0  or 
(D2)  ft- 1  is  convex  in  9,  and  yt  <  0. 

Theorem  1  For  the  system  given  by  Eq.  ( 18),  iff  is  NLP -persistently  exciting  and  9t  £  ©  Vt,  then 
9t  — >  0  as  t  — >  oo. 
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3.1.2  An  example  of  NLP-persistent  excitation 

In  this  section,  we  provide  one  example  of  the  function  /  and  a  corresponding  input  <fi  that  satisfy 
conditions  (NLP-I)  and  (NLP-11)  so  as  to  enable  parameter  convergence.  This  example  is  given  by: 

/  =  e -<pT9  (20) 

where  (j)  :  N  — >  1R",  9  £  0  C  1RN.  The  following  definition  states  the  desired  property  of  the 
probing  signal  f>. 

Definition  2  Let  w  €  lRn  be  any  unit  vector.  A  bounded  function  <\>  :  N  -»  lRn  is  said  to  belong 
class  Kn  if  for  any  ta  >  t0,  there  exist  positive  constants  and  T,  and  a  time  instant  tp  £ 
[fa  +  1,  ta  +  T]  such  that 

Definition  2  states  that,  periodically,  the  vector  (f>  should  have  a  positive  component  along  every 
w  in  IRn.  This  is  more  restrictive  than  the  linear  case  requirements  [20],  since  the  latter  requires  f 
to  merely  have  a  nonzero  component  periodically  along  every  vector  in  IRn. 

Lemma  2  For  f  defined  as  in  Eq.  (20),  f>  £  Kn  implies  that  <p  is  NLP -persistently  exciting. 

An  example  of  a  function  that  belongs  to  class  K2  is 

f  =  [sin  vt ,  cosvt  ]T  (21) 

Since  such  a  (p  represents  a  rotating  vector  1R2  with  a  constant  angular  velocity,  it  follows  that  it 
aligns  itself  with  every  w  in  IR2  periodically. 

3.1.3  A  special  case 

A  specific  example  of  an  NLP  system  is  one  that  contains  sinusoidal  signals  with  unknown  fre¬ 
quencies  and  amplitudes,  of  the  form 

71 

y{t)  =  Ylai  sin  (u)i<t>(t)) 

i—X 

and  the  task  is  to  estimate  al  and  Ui  using  all  available  data.  Such  problems  arise  in  a  number  of 
applications  related  to  vibration,  noise  suppression,  and  precise  positioning  [19].  Given  that  cu*  is 
a  parameter  that  occurs  nonlinearly,  the  question  is  whether  direct  estimation  of  u)l  and  Oj  can  be 
carried  out  using  the  approaches  that  were  discussed  above.  Our  preliminary  investigations  show 
that  an  estimation  algorithm  of  the  form 

y  =  X)sisin(^) 

i=l 

Si  =  -(y-y)sin(tDi^) 

&i  =  -(y-y)9i  (22) 

where  correspond  to  the  gradient  of  the  nonlinearity  evaluated  at  the  current  parameter  estimate 
leads  to  global  parameter  convergence  under  certain  conditions. 
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3.2  Parameter  Convergence  in  Continuous-time  Systems 

In  this  section,  results  related  to  continuous-time  systems  are  presented.  First,  we  consider  sys¬ 
tems  with  convex/concave  parameterization  where  sufficient  conditions  are  derived  under  which 
parameter  estimates  converge  to  their  true  values  using  a  min-max  algorithm  as  in  [12].  Next, 
we  consider  general  parameterizatons  where,  to  achieve  parameter  convergence,  a  hierarchical 
min-max  algorithm  is  proposed  where  the  lower-level  consists  of  a  min-max  algorithm  and  the 
higher-level  component  updates  the  bounds  on  the  parameter  region  within  which  the  unknown 
parameter  is  known  to  lie.  Using  this  hierarchical  algorithm,  a  necessary  and  sufficient  condition 
is  established  for  global  parameter  convergence  in  systems  with  a  general  nonlinear  parameteriza¬ 
tion.  In  both  cases,  the  conditions  needed  are  shown  to  be  stronger  than  linear  persistent  excitation 
conditions  that  guarantee  parameter  convergence  in  linearly  parametrized  systems.  Explanations 
and  examples  of  these  conditions  and  simulation  results  are  included  to  illustrate  the  nature  of 
these  conditions  are  also  included.  A  general  definition  of  Nonlinear  Persistent  Excitation  (NLPE) 
that  leads  to  parameter  convergence  is  proposed  at  the  end  of  the  paper. 

Our  objective  is  to  identify  unknown  parameters  in  a  class  of  nonlinear  systems  of  the  form 

V  =  -a(u)y  +  f(90 ,  it)  0  <  amin  <  a(u )  <  amax.  (23) 

where  90  £  C  lRn  are  bounded  unknown  parameters  and  u  £  IRm  are  inputs.  The  function  /  is 
a  scalar  valued  function  given  by  /  :  IRn  x  IRm  — >•  IR. 

We  make  the  following  assumptions  regarding  u  and  /. 

Assumption  1  The  input  u  is  Lipschitz  in  t  so  that 

IN*i)  -  u(f2)||  <  Ub\\ti  -  t2 1|,  Vti,t2  £  1R+. 

Assumption  2  /  is  Lipschitz  with  respect  to  its  arguments,  i.e. 

1/(0  +  A 9,u  +  Am)  -  f(9, m)|  <  B*||(Am,  A0)||  <  B,(||Au||  +  ||A0||). 

Let  a  set  U/  be  defined  as  follows: 

Vi  —  {«i,  %  -  1, Ui  ^  Uj ,  i  ±  j,  Ui  £  fftm}.  (24) 

We  introduce  the  definition  of  an  identifiable  function  which  is  necessary  for  parameter  conver¬ 
gence. 

Definition  3  A  function  f(9,  u),  6  £  Q  C  IRn  is  identifiable  over  parameter  region  f2  with  respect 
to  Ui  if  there  does  not  exist  6ly  02  GO  and  9i  f  92  such  that 

lim  f(9,  Ui)  =  lim  f(9,  u{)  Vuj  €  Ui,  i  =  1, ...,  7. 

i  v — y(/2 

Definition  3  implies  that  identifiability  follows  if  the  system  of  equations 

f(9,Ui)-f(6o,Ui)  =  0  VmeUi  (25) 
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has  a  unique  solution  9  =  9q  for  any  90  €  fi.  Equation  (25)  provides  a  procedure  for  constructing 
Ui  such  that  for  a  given  fi,  /  can  become  identifiable  over  Q.  That  is,  the  number  I  and  the  value 
Ui,  for  i  =  1, /  must  be  chosen  such  that  Eq.  (25)  has  a  unique  solution. 

We  also  note  that  for  a  given  0,  identifiability  of  /  is  dependent  on  the  choice  of  Uj.  For 
example,  if  /  is  linear,  then  /  is  identifiable  over  any  9  e  1R"  if  elements  of  (7/  span  the  entire 
space  of  JRm;  for  a  nonlinear  /,  identifiability  may  be  possible  even  if  these  elements  span  only  a 
subspace.  We  notice  that  if  /  is  not  identifiable  with  respect  to  [//,  it  implies  that  we  have  no  way 
of  identifying  90  using  any  input  Ui  in  Uj. 

The  dynamics  of  parameter  estimation  algorithm  that  we  propose  is  the  same  as  the  min-max 
algorithm  in  [12]  and  is  as  follows:  Suppose  (2°  is  the  unknown  parameter  region. 


y  =  -a(u)yt  +  f(9,  u )  -  f(90,  u )  -  a*sat( f ) 

e  =  -ytp. 


(26) 


where 

y  =  y-y,  y<  =  y-esat( |),  e  =  6-90, 
and  a*  and  <f>*  come  from  the  solution  of  an  optimization  problem 

a*  =  min  ma xq(9,u,d>) 

<*>eiRm0en*  v  ' 

6*  =  arq  min  max  a(9,  u,  6) 

g(9,u,<j))  =  sat(J^  (f(§,u)~  f(9,u)-<f)T(9-9)y 

Our  objective  is  to  find  conditions  on  u  and  /  so  that  the  system  in  (26)  is  uniformly  asymptotically 
stable  in  the  large. 


(27) 

(28) 


3.2.1  Parameter  Convergence  in  Systems  with  Convex/Concave  Parameterization 

The  main  stability  result  is  stated  in  in  this  section  in  Theorem  2.  As  mentioned  earlier,  the  region 
of  attraction  of  the  trajectories  of  (26)  is  shown  to  be  a  neighborhood  D(  of  the  origin  x  =  0. 

Theorem  2  If  (i)  f(9,  u(t ))  is  convex  (or  concave)  on  Q,  for  any  u(t )  E  IRm,  and  (ii)  for  every 
ti  >  to,  there  exist  positive  constants  T0,  eu  and  a  time  instant  t2  £  [ti,  t\  +  T0]  such  that  for  any 
9 

f(u(t2))(f(9,u(t2))-f(90,u(t2)))  >  e„||0-  0O||>  (29) 

where  fi(u2)  =  1  iff  is  convex  and  —1  is  f  is  concave,  then  all  trajectories  of  (26)  will  converge 
uniformly  to 

De  =  {x  |  v(x)  <  7i},  (30) 

where 

2c 

7l  =  —  (l6BeUb  +  8BeBt  +  4Bj)  ,  (31) 
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e  is  defined  as  in  (26),  eu  is  given  by  (29),  Ub  and  Bq  are  defined  as  in  Assumptions  1  and  2,  and 
Btj,  is  the  bound  on  <j>*  in  (28)  so  that 

U*(t)\\<Bt,  Vt>t0 ,  Vt>t0. 

The  proof  of  Theorem  2  follows  by  showing  that  if  u  and  /  are  such  that  condition  (29)  is 
satisfied,  then  yt  ( t )  becomes  large  at  some  time  t  over  the  interval  [fi ,  t x  +  T0] .  Once  ye (t)  becomes 
large,  it  follows  that  V ( t )  decreases  over  the  interval  [ti,ti  +  T0]  by  a  finite  amount. 

Remark  1:  If  /  is  concave  (or  convex)  for  all  0  G  fi,  and  if  /  satisifes  the  inequality  in  Eq. 
(29),  we  shall  define  that  /  satisfies  the  Convex  Persistent  Excitation  (CPE)  condition  with  respect 
to  u.  Theorem  2  implies  that  if  /  satisfies  the  CPE  condition  with  respect  to  u,  then  parameter 
convergence  to  a  desired  precision  e  follows. 

Remark  2:  From  the  definition  of  De,  it  automatically  follows  that  as  e  -»  0,  all  trajectories 
converge  to  the  region  x  ~  0  and  hence  u.a.s.l.  follows. 


3.2.2  Sufficient  Condition  for  Parameter  Convergence 

The  CPE  condition  specifies  certain  requirements  on  /  in  order  to  achieve  parameter  convergence. 
For  a  given  /,  theorem  2  does  not  state  how  u  should  behave  over  time  in  order  to  satisfy  (29).  In 
this  section,  we  state  some  observations  and  examples  of  u  that  satisfies  (29)  for  a  general  /. 

Equation  (29)  consists  of  two  separate  requirements.  Denoting  /  =  f(9,  u )  —  f(90,u ),  the  first 
requirement  is  that  the  magnitude  of  /  must  be  large.  The  second  requirement  is  that  /  must  have 
the  same  sign  as  j3.  The  first  component  states  that  for  a  large  parameter  error,  there  must  be  a  large 
error  in  /.  It  is  straightforward  to  demonstrate  that  this  condition  is  equivalent  to  linear  persistent 
excitation  condition  in  [20],  and  is  shown  in  section  3.2.3.  The  second  requirement  states  what  the 
sign  of  /  should  be  in  relation  to  the  convexity/concavity  of  /.  If  /  is  convex,  /  should  be  positive, 
and  conversely,  if  /  is  concave,  /  should  be  negative. 

The  coupling  of  convexity/concavity  and  the  sign  of  the  integral  of  /  has  the  following  practical 
implications.  Suppose  that  u  is  such  that  /  is  always  identifiable.  To  ensure  parameter  convergence, 
u  must  be  such  that  one  of  the  following  occurs:  At  least  at  one  instant  t2  G  [fi,  ti+T], 

(a)  For  the  given  9,  u  must  change  in  such  a  way  that  the  sign  of  f  is  reversed,  while  keeping 
the  convexity/concavity  of  /  the  same,  or 

(b)  For  the  given  9,  u  must  reverse  the  convexity/concavity  of  /,  while  preserving  the  sign  of  / 

3.2.3  Examples 

We  illustrate  the  above  comments  using  specific  examples  of  /.  Suppose 

/  =  e~uTe  (32) 

where  u  :  1R  — »  lRn,  9  G  fi!  C  1R".  It  can  be  checked  that  /  given  in  (32)  is  always  convex 
with  respect  to  9  for  all  u.  Therefore,  option  (b)  is  not  possible.  Hence,  u  must  be  such  that  /  can 
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switch  sign  for  any  9  as  required  by  option  (a).  One  example  of  such  a  u  is  if  for  any  t\,  there 
exists  t2  €  [fi,  ti  +  T]  such  that 

uT(t2)w  >eu  (33) 

where  u>  is  any  unit  vector  in  IRn.  Another  example  which  satisfies  condition  (29)  is  given  by 

f  =  9u,  u  €  IR. 

It  is  easy  to  show  that  for  such  an  /,  condition  (b)  is  satisfied  if  u  switches  between  u\  and  u2 
where  Ui  <  1  and  u2  >  1. 

The  above  examples  show  that  the  condition  on  u  that  satisfies  Eq.  (29)  varies  with  /. 

Relation  to  Conditions  of  Linear  Persistent  Excitation  The  relation  between  CPE  and  LPE  is 
worth  exploring.  For  this  purpose,  we  consider  a  linearly  parameterized  system,  which  is  given  by 
Eq.  (23)  with 

f{9 o,u)  =  9^(f)[u) 

where  4>{u)  e  lRm.  In  this  case,  it  is  well  known  that  the  corresponding  estimator  is  given  by 
equation  (26)  with  a*  =  0  and  (j>*  =  <f>  [5].  The  resulting  error  equations  are  summarized  by 

y  =  -a(u)y€  +  0T<j>(u) 

a  ~  At  \  (34) 

9  =  -ye(f>{u). 

In  [20],  it  is  shown  that  u.a.s.l.  of  (34)  follows  under  an  LPE  condition.  For  the  sake  of  complete¬ 
ness,  we  state  this  condition  below. 

Definition  (LPE):  <f>  is  said  to  be  linearly  persistent  exciting  (l.p.e.)  if  for  every  fi  >  t0,  there 
exists  positive  constants  T0,  5o,  e0  and  a  subinterval  [t2,  t2  +  50]  £  [h,  ti  +  To]  such  that 

ft2  +  S  o 

|/  6  (f>(u(r))dT\  >  eo\\0\\.  (35) 

Jt2 

We  now  show  the  relation  between  the  LPE  condition  and  the  CPE  condition  in  (29).  When 
f(9,  u)  =  QT(f>(u),  if  Assumption  1  holds,  it  can  be  shown  that  the  LPE  condition  is  equivalent  to 
the  following  inequality:  For  every  ti  >  t0  and  9,  there  exists  positive  constants  T0,  e0  and  a  time 
instant  t2  €  [ti,  tj  +  T0]  such  that 

\f(9,u(t2))~  f(90,u(t2))\  >  eu\\9  —  ||-  (36) 

Since  a  linear  function  can  be  considered  to  be  either  convex  or  concave,  the  inequality  in  (36)  is 
equivalent  to  the  CPE  condition  in  (29).  This  equivalence  is  summarized  in  the  following  lemma: 

Lemma  3  When  f(9,u)  =  9T(j)(u),  if  Assumption  1  holds,  the  CPE  condition  in  Eq.  (29)  is 
equivalent  to  the  LPE  condition  in  Eq.  (35). 

It  should  be  noted  that  for  a  general  nonlinear  /,  the  CPE  condition  becomes  more  restrictive  than 
the  LPE  condition.  For  example,  for  /  as  in  (32),  the  CPE  condition  implies  that  u  must  satisfy 
(33).  On  the  other  hand,  if  /  =  ur9,  even  if  u  is  such  that  \uT(t2)w\  is  periodically  large,  the  LPE 
condition  is  satisfied. 
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A  Counter-example  For  a  general  function  /,  it  may  not  be  possible  to  find  a  u  that  satisfies  either 
condition  (a)  or  (b)  mentioned  above.  A  simple  example  is 

/  =  cos(6u ) 

where  |u|  <  umax  and  9  6  [0,  7r/(2umQX)].  We  note  that  /  is  concave  and  monotonically  decreas¬ 
ing  for  any  u  with  |w|  <  umax.  Hence  neither  (a)  nor  (b)  is  satisfied.  That  is,  it  is  possible  for 
the  min-max  algorithm  to  result  in  the  parameter  estimate  9  to  get  ’’stalled”  in  a  region  infl0.  This 
motivates  the  need  for  an  improved  min-max  algorithm,  and  is  outlined  in  section  3.2.4. 


3.2.4  Parameter  Convergence  in  Systems  with  a  General  Parameterization 

In  the  previous  section,  we  showed  that  if  a  function  /  is  convex  (or  concave),  and  if  /  and  u 
satisfy  the  CPE  condition,  then  parameter  convergence  follows.  However,  as  we  saw  in  section 
3.2.3,  not  all  convex/concave  functions  can  satisfy  the  CPE  condition.  In  this  section,  we  present 
a  new  algorithm  which  not  only  allows  the  persistent  excitation  condition  to  be  relaxed  but  also 
enables  parameter  convergence  for  non-convex  and  non-concave  functions. 

The  algorithm  we  present  in  this  section  is  hierarchical  in  nature,  and  consists  of  a  lower-level 
and  a  higher-level.  In  the  lower-level,  for  a  given  unknown  parameter  region  Cl°,  the  parameter 
estimate  6  is  updated  using  the  min-max  algorithm  as  in  (26).  In  the  higher-level,  using  information 
regarding  the  parameter  estimate  6  obtained  from  the  lower-level,  the  unknown  parameter  region 
is  updated  as  Cl1.  Iterating  between  the  lower  and  higher  levels,  the  overall  hierarchical  algorithm 
guarantees  a  sequence  of  parameter  region  Clk.  The  properties  of  these  two  levels  are  discussed 
below. 

Lower-level  Algorithm  The  lower-level  algorithm  consists  of  the  min-max  parameter  estimation 
as  in  (26)  with  the  unknown  parameter  60  G  Clk.  We  show  in  this  section  that  when  this  algorithm 
is  used,  the  asymptotic  convergence  of  ye(t)  to  zero  occurs  in  a  finite  time.  Once  ye  becomes  small, 
we  estimate  the  region  that  the  unknown  parameter  can  lie  in  using  the  corresponding  parameter 
estimate  6k.  This  region  is  used  in  the  higher-level  part  of  hierarchical  algorithm  to  update  the 
unknown  parameter  region  from  Clk  to  Clk+l .  The  convergence  of  y£  is  stated  in  Lemma  4,  and  the 
characterization  of  the  unknown  parameter  is  stated  in  Lemma  5. 

Lemma  4  For  the  system  in  (23)  and  the  estimator  in  ( 26),  given  any  positive  T  and  5,  there  exists 
a  finite  time  ti  such  that 

\yM<$  forti  <t  <t\+T.  (37) 

We  note  that  for  every  specific  input  u,  a  time  t\  that  satisfies  (37)  exists.  However  the  value 
of  ti  will  depend  on  the  choice  odf  u.  Since  our  goal  is  parameter  convergence,  we  require  u  to 
assume  distinct  values,  i.e.  persistently  span  a  set  of  interest.  This  is  stated  in  the  definition  below. 

Let  Uj  be  defined  as  in  Eq.  (24). 

Definition  4  u  is  said  to  persistently  span  Uj  if  for  any  Ui  £  Ui  and  any  f,  there  exist  a  finite  Ti 
and  Ti  such  that 

u(ri )  =  Ui  n  e  [ii,  ti  +  Ti]  i  =  1, ...,  /.  (38) 
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Definition  4  implies  that  u  periodically  visits  all  points  in  [//. 
Let 

Bt  =  2Be(6B<t>  +  2Ub)  +  8Bl, 

if  we  choose  T  as 


(39) 


T  =  max  Ti  + 

l<i<I 


2\/ Bt(S  +  e) 


Bt 


where  Tj  is  given  by  (38),  then  Lemma  4  implies  that  there  exists  a  finite  time  t\  such  that 

\ye(t)\<6  t\  <  t  <  ti  +  T. 


(40) 


When  y€  satisfies  (40),  we  refer  to  it  as  lower-level  convergence.  If  u  persistently  spans  Uj,  then 
Definition  1  and  the  choice  of  Tj  implies  that  at  Tj  E  [fx,  fx  +  T],  u(rj)  —  m,  i  =  1, The 
parameter  estimate  0(t j)  at  time  instances  are  defined  as 

0Ci=Hri)  i  = 


and  are  denoted  as  low-level  convergent  estimates.  We  characterize  the  region  where  the  unknown 
parameters  lie  in  lemma  5  using  these  lower-level  convergent  estimates. 


Lemma  5  For  the  system  in  (23)  and  estimator  in  (26),  let  Q  be  the  unknown  parameter  region 
and  Of,  i  =  1, be  the  lower-level  convergent  estimates.  If  the  input  u  persistently  spans  Uj, 
then 

i 

0o  €  f)  $e(Cl,Ui,e,5,0f). 


$e(Cl,Ui,e,5,§f)  =  j#  E  Q\f.  <  f(0,Ui )  <  /j} 

Li  =  f0ct,  Ui)  -  a*+(0ci,  u )  -  amax8  -  2 y/Bt(5  +  e) 
7 i  =  /(0i,  «i)  +  o*_(0f,  ti)  +  amaxS  +  2yjBt{5  +  e)} 

and  Bt  as  in  (39). 


Higher-Level  Algorithm  We  now  present  the  higher-level  component  of  the  hierarchical  algo¬ 
rithm.  Here,  our  goal  is  to  start  from  a  known  parameter  region  Qk  that  the  unknown  parameter  0Q 
lies  in,  and  update  it  as  £lk+l  using  all  available  information  from  the  lower-level  component.  In 
particular,  we  use  to  update  Clk.  In  order  to  reduce  the  parameter  uncertainty,  different  $'es  are 
computed  by  varying  Ui,i  =  1, ...,  I.  The  resulting  fl*+1  is  chosen  as 

n‘+1  = 

i=l 

We  state  the  complete  hierarchical  algorithm  below: 

Step  HI:  Set  k  —  0  and  Qk  =  Q°,  and  T  =  maxj  Tj  +  +  e)/Bt. 
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Step  H2:  Run  the  estimator  in  (26).  Wait  until  time  t*k  where 

\Ve(t)\  <5  for  t  €  [t*k,  t*k  +  T], 
and  record  the  low  level  convergent  estimate  Of  as 

«?  =  Hn) 

where 

u{Ti)  =  uh  V  Tj  G  [ffc,  +  T], 

Step  H3:  Calculate  0*+1  from  and  Of,  i  =  1,  ...7,  as  follows: 

1=1 

Step  H4:  If  S7fc+1  =  Qk,  stop.  Otherwise,  set  k  =  A:  +  1  and  return  to  step  2. 

The  question  that  remains  to  be  answered  is  whether  is  a  strict  subset  of  flk  so  that 
parameter  convergence  of  0  to  00  can  be  ensured. 

Parameter  Convergence  with  the  Hierarchical  Algorithm  We  now  address  the  question  of  pa¬ 
rameter  convergence  of  the  hierarchical  algorithm.  For  ease  of  exposition,  we  set  e  =  5  =  0.  The 
effects  of  nonzero  e  and  5,  as  mentioned  above,  simply  affect  the  accuracy  of  the  parameter  error. 
For  e  =  5  —  0,  the  hierarchical  algorithm  can  be  summarized  as  follows: 

Step  1:  Set  k  =  0  and  Q,k  =  0°,  and  5  -K). 

Step  2:  Run  the  estimator  in  (26).  Wait  until  time  t*k  where 

\m\  <S  for  te[t*k,  t*k+T ], 

and  record  the  low  level  convergent  estimate  Of.  =  0(t)  t  e  K  n+T ] 

Step  3:  Calculate  from  Qk  and  Of  as  follows: 

ft*+1  =  {« €  n*  |  /*  <  /(»„,  <n)  <  7f .  *  =  i, (4i) 

where 

Li  =  f{QCk>ui)  ~  a*+(0f,Ui),  i  =  1,  ...I 

7i  —  f  (Hi  ui)  +  a*_(0f,  Ui),  1  =  1,  ...I 

Step  4:  If  Qk+1  reduces  to  the  desired  precision,  we  are  done.  Otherwise,  set  k  =  k  +  1  and 
return  to  step  2. 

We  first  define  a  measure  F(S2*)  as 

m+1 

*=  l 
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— A:  k 

where  and  /.  are  defined  as  in  (41).  Next,  we  introduce  a  definition  for  a  “stalled”  parameter 
region  A- 

Definition  3:  For  any  ftcfla,  define  /*  and  J*  as 

f*  =  min  f(0,  Ui ),  Ti=  max  f(9,  u%) .  (42) 

Then  we  define  A,(fi)  to  be  a  “stalled”  estimate-region  of  ft  as 

A i(O)  -  {0  |  f(9,Ui)  -  a*+(0,Ui)  <  f*  and  f(9,Ui)  +  a*_(6,Ui)  >  J*}-  (43) 

We  now  prove  a  property  of  At(f2)  which  explains  why  it  corresponds  to  a  “stalled”  region  in  ft. 

Lemma  6  IfOc  €  Ai(flk)  for  any  k,  then 

nj  =  fik,  j  =  k  + 1,... 

Proof  of  Lemma  6  follows  directly  from  the  definition  of  A i  and  the  construction  of  ftk+1  in 
(41). 

In  Theorem  3,  we  propose  the  conditions  needed  for  the  higher-level  convergence. 


Theorem  3  For  the  system  in  (23)  and  estimator  in  (26),  let  f  be  identifiable  over  ft  w.r.t.  Ui  and 
u  persistently  span  Uj.  The  hierarchical  algorithm  outlined  in  Steps  H1-H4  guarantees  that 


lim 

t — >oo,<£ — >0,6 — >0 


m  =  0O 


(44) 


if  and  only  if  for  any  ficfio  where  0q  € 


p|  Afity^for  f|  Aj(Q)  =  {0o  }■  (45) 


where  f  denotes  the  null  set. 


Remark  3:  If  f{9,u)  is  identifiable  over  ft  with  respect  to  Ui,  u  persistently  spans  Ur,  and  / 
satisfies  the  inequality  (45),  we  shall  define  that  /  satisfies  the  Nonlinear  Persistent  Excitation 
(NLPE)  condition  with  respect  to  u.  Theorem  2  implies  that  then  NLPE  of  /  with  respect  to  u  is 
necessary  and  sufficient  for  parameter  convergence  to  take  place. 

Remark  4:  The  requirement  on  u  for  /  to  satisfy  the  NLPE  can  sometimes  be  less  stringent  than 
that  on  u  for  LPE.  An  example  of  this  fact  is  for  the  parameter  0  =  [a,  uj]t,  and  the  cases  (i) 
1(9)  —  9Tu,  and  (ii)  /(0)  =  au\  cospm2)  where  ux  and  u2  are  the  elements  of  u.  Clearly,  for  a  u 
such  that  Ui  =  ku2,  where  A;  is  a  constant,  u  does  not  satisfy  LPE,  but  /  does  satsify  NLPE  with 
respect  to  u.  As  shown  in  Section  3.2.3,  NLPE  can  impose  more  stringent  conditions  on  u  as  well. 

Remark  5:  It  should  be  noted  that  the  NLPE  condition  guarantees  parameter  convergence  for  any 
general  nonlinear  function  /  that  is  identifiable.  This  implies  that  the  min-max  algorithm  outlined 
in  [21],  which  is  applicable  for  even  a  non-convex  (or  a  non-concave)  function,  can  be  used  to 
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establish  parameter  convergence.  We  include  simulation  results  of  such  an  example  in  Section 
3.2.5. 

Remark  6:  It  should  be  noted  that  a  fairly  extensive  treatment  of  conditions  of  persistent  excitation 
has  been  carried  out  in  [22,  23]  for  a  class  of  nonlinear  systems.  The  systems  under  consideration 
in  this  paper  do  not  belong  to  this  class.  The  most  distinct  features  of  the  system  (23)  is  the 
presence  of  the  quantity  a*  and  the  quantity  f(0,u)  -  f(0o,u),  where  the  former  can  introduce 
equilibrium  points  other  than  zero  and  the  latter  is  not  Lipschitz  with  respect  to  9  -  9.  As  a  result, 
an  entirely  different  set  of  conditions  and  properties  have  had  to  be  derived  to  establish  parameter 
convergence. 

Relation  between  NLPE  and  CPE  In  what  follows  we  compare  the  NLPE  and  the  CPE  condi¬ 
tions.  In  order  to  facilitate  this  comparison,  we  restate  the  CPE  condition  in  a  simpler  form: 


Definition  5  /  is  said  to  satisfy  the  CPE'  condition  with  respect  to  u  if(i)  f(d,  u(t ))  is  convex  (or 
concave )  oh  Cl  for  any  u(t)  €  IRm,  and(ii)  u  is  persistently  spanning  with  respect  to  UT,  and 

(iii)  f{ui)  ( f(9 ,  m)  -  f(0o,  m ))  >  6h||  9  -  0O||,  Vut-  e  £//,  (46) 

We  note  that  the  only  distinction  between  the  inequalities  in  (29)  and  (46)  is  in  the  value  taken 
by  u(t2)  for  some  t2  in  the  interval  [t,  t  +  T).  In  (46)  it  implies  that  u(t2)  assumes  one  of  the  finite 
values  Ui  in  Ur  while  in  (29),  the  corresponding  Uj  can  consist  of  infinite  values.  If  u  is  “ergodic” 
in  nature  so  that  it  visits  all  typical  values  that  it  will  assume  for  all  t  over  one  interval,  then  it 
implies  that  the  two  conditions  (29)  and  (46)  are  equivalent.  We  shall  assume  in  the  following  that 
the  input  is  “ergodic.” 

Lemma  7  Let  f(0,  u ,)  be  convex  (or  concave)  for  all  9  <=  Cl°  and  ClcCl0.  Then  the  CPE'  condition 
implies  the  NLPE  condition. 

Remark  5:  Lemma  7  shows  that  the  CPE'  condition  is  sufficient  for  the  NLPE  to  hold  if  /  is 
convex  (or  concave).  Clearly,  the  CPE'  condition  is  not  necessary,  as  shown  by  the  counterexample 
in  Section  3.2.3.  The  NLPE  condition  therefore  represents  the  most  general  definition  of  persistent 
excitation  in  nonlinearly  parameterized  systems. 


3.2.5  Simulation  Results 

We  consider  the  system  in  (23)  and  the  estimator  in  (26)  to  evaluate  the  performance  of  the  hierar¬ 
chical  algorithm.  The  system  parameters  are  chosen  as  follows: 

f  =  (e_I)  +12^p{-5(»-2+|)2} 

where  9  is  an  unknown  parameter  that  belongs  to  a  known  interval  Cl  =  [0,5].  The  input  u  is 
chosen  as  a  sinusoidal  function  u  =  1.1  sin(2 1).  We  note  that  the  function  /  is  non-convex  (and 
non-concave),  whose  values  are  shown  in  Figure  2  for  u  —  1,  -1,0.  It  can  be  shown  that  /  is 
identifable  with  respect  to  Cl  and  that  u  is  persistently  spanning  with  respect  to  17/  =  {1,— 1,0}. 
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Figure  1.  A  non-concave  (and  non-convex)  function  f(9,  u )  vs.  9,  for  u  =  1,0,  —1.  f(9, 1): — , 
f(9,-l):---,f(9,0): . 


Figure  2.  The  output  error  ye(t)  with  t  using  the  hierarchical  algorithm,  e  =  0.001  and  6  =  0.02. 


The  hierarchical  algorithm  in  (26)  together  with  steps  HI  to  H4  was  implemented  to  estimate 
9.  The  parameters  e  =  0.001  and  5  =  0.02.  Since  u  is  a  sinusoid,  the  parameter  T  was  set  to 
the  corresponding  period  7 r.  The  resulting  output  error  yt,  parameter  estimate  9,  and  the  update 
of  the  parameter  region  H  are  shown  in  Figures  3-  5,  respectively.  The  evolutions  of  the  lower 

— k 

and  upper  bounds  /?  and  =  1,  2, 3  with  respect  to  t  are  also  shown  in  Figure  6.  A  similar 
convergence  was  observed  to  occur  for  any  90  in  H.  These  figures  show  that  the  update  of  Qk  is 
not  necessarily  periodic.  Once  yc  becomes  smaller  than  S  over  an  interval  T,  the  corresponding 
parameter  estimates  and  the  upper  and  lower  bounds  on  /*  and  therefore  on  O  are  computed.  It  was 
also  observed  that  just  the  min-max  algorithm  without  the  higher  level  component  did  not  result  in 
parameter  convergence. 
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Figure  3.  The  parameter  estimate  6(t)  with  t  using  the  hierarchical  algorithm.  True  parameter 
value  6q  =  2. 


Figure  4.  The  evolution  of  the  parameter  region  Qk  with  t,  using  the  hierarchical  algorithm.  Note 
that  is  updated  at  instants  t*k  such  that  |ye(f)|  <  5  for  t  €  [t*k  —  T,  <£]. 


Figure  5.  The  upper-bounds  /2  and  lower-bounds  f_.  of  f(6,  ut )  with  t  using  the  hierarchical 
algorithm,  for  m  =  1,-1,0.  Ji./,- — .  I2 JiJ ?■■■■■ 


4  Summary 


Under  this  award,  a  systematic  adaptive  control  theory  for  nonlinearly  parameterized  systems  has 
been  derived.  Adaptive  control  results  for  systems  with  a  triangular  structure  have  been  demon¬ 
strated,  establishing  global  stability.  Significant  results  for  parameter  convergence  in  such  systems 
have  been  derived,  establishing  the  concept  of  Nonlinear  Persistent  Excitation  for  systems  with 
nonlinear  parameterization  and  are  illustrated  using  several  examples.  These  results  are  expected 
to  have  a  significant  impact  on  modeling  and  control  of  complex  physical  systems. 
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